Multimedia Messenger and Multimedia PBX Server for Firewall and Virtual-IP Environment

专利摘要:
PURPOSE: A multimedia messenger and a multimedia electronic switching system for supporting a fire wall and a virtual IP are provided to support a many-to-many communication of communication functions for an instant message, a voice, an image, a file, a white board, other cooperation task between end-to-end of the Internet regardless of virtual IP or fire wall. CONSTITUTION: A GET(21) processing unit of each client is connected to an initial session manager(20) by an HTTP tunneling. A doGet(23) processing unit of a session manager receives a request of a client, enters a waiting state, and maintains a connection. A predetermined client transmits a specific request to a doPost(24) of the session manager through a POST(22) processing unit. The session manager interprets contents of a request of the client, searches an object client to be transmitted, and transmits a message to the doGet(23) processing unit of a searched client. The doGet(23) processing unit transmits a message as a response with respect to a GET of a connected client. If an initial request is completed, a GET connection for receiving actual media and a POST connection for transmitting the media are connected to a doGet and a doPost of a distribution engine of a server. Actual data(30) to be connected are transmitted by a POST, and a receiving client receives data by a GET. The distribution engine distributes actual data to all clients having a created session ID.
公开号:KR20030073911A
申请号:KR1020020013677
申请日:2002-03-13
公开日:2003-09-19
发明作者:고대식；박준석
申请人:주식회사 알파인터넷；
IPC主号:

专利说明:

Multimedia messenger and multimedia exchanger that supports firewall and virtual IP {Multimedia Messenger and Multimedia PBX Server for Firewall and Virtual-IP Environment}
[24] Internet Peer-To-Peer services are very diverse and are exploring many new applications, but due to the nature of the underlying end-to-end protocols, they do not effectively address the problem of virtual IP used in firewalls or home networks used in most enterprise environments. I can't.
[25] Instant messenger, a representative example of peer-to-peer application, has recently been in the spotlight as a tool for in-house collaboration by combining voice and video communication technology as well as the function of simple text messages. However, since most institutions are equipped with a firewall, communication with the outside is impossible in principle, and is limited to simple text communication via a server. The basic solution is to use H.323 Gatekeeper-Proxy and SOCKS protocol. However, this technique is possible only if both ends are equipped with the above system. In contrast, the present invention can support a firewall and virtual IP even if only one place is installed, not both ends, and supports various services such as instant messaging, text chat, screen sharing, as well as many-to-many voice / video communication. do.
[26] The present invention provides a multimedia messaging system that supports communication between the Internet end-to-end instant messaging, voice, video, files, whiteboards, and other collaborative operations, allowing for many-to-many communication, regardless of virtual IP and firewall. A multimedia electronic exchange for support.
[27] The technology to be invented is an end-to-end communication technology made by a new concept of server exchange, server exchange / distribution, and supports multi-party communication in a firewall and virtual IP environment, thereby enabling effective mutual cooperative work on the Internet.
[28] To achieve this
[29] ① In general, real-time voice and video are transmitted and received using RTP / UDP / IP, but they are implemented in the form of RTP / TCP / IP for server exchange.
[30] ② The transmitting and receiving channel should be separated by different connection, and the receiving channel should be connected to the server at all times, and the transmitting channel is created during the transmission of media.
[31] ③ In one session where multiple participants exist, one client is connected to the server by one transmission channel and receiving channel, and the receiving channel must distinguish a plurality of media information from the contents of data.
[32] (4) The server exchange shall send data sent from one client to all clients in the same session.
[33] ⑤ The server shall play the role of exchange as a response to the client's request. When the other client transmits data for media transmission, it should send a response to the client. To do this, you must be able to hold the response instead of immediately responding to the client's request.
[34] ⑥ Multimedia data, ie audio, should be compressed to G.723.1 / G.729 / GSM, moving picture to MPEG / H.261 / H.263, and still picture to JPEG / PNG.
[35] ⑦ The exchange server should be implemented separately for the type of media to be exchanged, namely voice / video / whiteboard / screen sharing / file transfer, etc. for effective load balancing.
[36] ⑧ For convenience of communication, it should be implemented based on instant messenger including status information.
[1] 1 is a schematic diagram of an entire system according to the present invention
[2] 2 is a schematic diagram of a data transmission / reception method between client and server according to the present invention;
[3] Figure 3 is a schematic diagram of the role of data exchange of multimedia S / W-PBX according to the present invention
[4] 4 is a block diagram showing a functional configuration and a hierarchy of a client module according to the present invention
[5] 5 is a block diagram showing the functional configuration and hierarchy of the exchange module according to the present invention
[6] 6 is a protocol flowchart at the time of call setup according to the present invention.
[7] 7 is a flowchart of actual voice data after call setup according to the present invention.
[8] <Description of the code | symbol about the principal part of drawing>
[9] 00: Module that performs the function of delivering and managing call setup message between clients
[10] 01: HTTP GET connection of client for call setup
[11] 03: Processing routine for HTTP GET of server for call setup
[12] 06: HTTP GET connection of client for receiving media data
[13] 09: Processing routine for HTTP POST of server for distribution of media data
[14] 10: HTTP tunneling and always-on connection module
[15] 11: Module for processing message type information
[16] 12: module for processing real-time data information
[17] 13: Module for processing file type information
[18] 14: data processing module between client / server
[19] 20: switching and deployment processing core engine module
[20] 21: Module for distributing information in messages
[21] 22: module for distributing information of real-time data
[22] 23: module for distributing file information
[23] 30: Client Software
[37] Hereinafter, described in detail by the accompanying drawings as follows.
[38] The present system is largely composed of Function components (10), Multimedia S / W-PBX (11), ART protocol (12) and load balancing (18).
[39] In FIG. 1, the function components, which are internal function modules of the client, refer to functional elements such as the voice 14 and the moving image 15 including the instant message 13, and in general, real-time data such as the voice / video are purely firewalls. Because it does not pass, it is encapsulated in HTTP. Encapsulated real-time data is HTTP tunneling (16) to the S / W-PBX (11) to send and receive information.
[40] Since RTP / UDP / IP protocol stack, which is generally used for real-time data transmission, cannot implement HTTP tunneling, it uses real-time data transmission technology based on TCP transport protocol instead of UDP.
[41] In addition, functions such as screen sharing, file transfer, and whiteboard are generally implemented using TCP, but are mainly implemented in a peer-to-peer format and thus cannot operate on the firewall 17 and the virtual IP. Therefore, these functions also need to send and receive information through S / W-PBX through HTTP tunneling.
[42] 2 illustrates a basic method of transmitting and receiving multimedia information on a firewall and virtual IP in a many-to-many manner.
[43] 1) The GET processor 21 of each client connects to the first session manager 20 by HTTP tunneling.
[44] 2) The session manager's doGet (23) processing unit accepts the client's request, enters the wait state, and maintains the connection.
[45] 3) Any client sends a specific request (25-message, phone call, etc.) to the doPost 24 of the session manager via POST 02 processing.
[46] 4) The session manager interprets the content of the client's request, finds the destination client that needs to be sent (switched), and delivers the message to the doGet processing of the found client.
[47] 5) The doGet processor delivers the message in response to the GET of the client connected by 1).
[48] 6) Upon completion of the initial request (call setup), a POST 28 connection is sent to each doGet (27) and doPost (29) of the server's distribution engine to send a GET 26 connection to receive the actual media. Connect.
[49] 7) The actual data 30 to be transmitted is sent by POST and the receiving client receives data by GET 26.
[50] 8) At this time, the distribution engine distributes the actual data to all clients with the generated session ID.
[51] 3 shows a data exchange role of the multimedia S / W-PBX 11. In FIG. 3, Multimedia S / W-PBX is a multimedia data exchange over IP implemented as a Java servlet. The multimedia S / W-PBX is composed of a text servlet 40, an audio servlet 41, and a video servlet 42. Multi-distribution to other clients 43, 44, 45 of the role.
[52] The client module is configured as shown in FIG.
[53] In Figure 4
[54] Session Manager 50 performs HTTP tunneling and always-on connection between client / server and maintains it.
[55] The Client / Server Signaling Module 54 manages user status information and lists of friends and organizational organizations, and calls and manages function modules according to user requests and server responses.
[56] The Message Module 51 performs the following functions and processes a function consisting of a short-lived message of non-real time (time is not required).
[57] Instant messaging: Send and finish text-oriented messages to the right person
[58] ㆍ Text Chat: The ability to continuously chat with the person
[59] ㆍ URL Synchronization: When you pass your own URL to your opponent, your opponent can browse directly to that URL.
[60] ㆍ Whiteboard: Function to open network whiteboard at the same time with opponent
[61] Realtime Streaming Module 52 serves to process continuous data in real time.
[62] ㆍ Voice Call: Voice call over network with PC using music card
[63] ㆍ Video call: The function of having a relative video conversation using a general web camera
[64] ㆍ Multimedia messaging: Sending text, voice and moving image data to other party in the form of instant messaging
[65] File Module 53 is used when a file unit function is required.
[66] ㆍ File Transfer: Send a file to the other party
[67] Screen sharing: Shows your screen to the other party and allows you to write and explain in real time
[68] 5 is a block diagram showing a functional configuration and a hierarchy of an exchange module.
[69] In Figure 5
[70] Distribution Core Engine 60 distributes multimedia data to configuration clients included in the session.
[71] Message Distribution Servlet (61) is a servlet that distributes message type information to participants in the same session.
[72] Realtime Distribution Servlet 62 is a servlet that distributes real-time data flow information to participants in the same session.
[73] File Distribution Servlet 63 is a servlet that distributes file-like information to participants in the same session.
[74] Client / Server Signaling Module 64 is a processing module according to a function request for a client to perform detailed functions.
[75] Meanwhile, ART protocols shown in the client module and the server module are shown in FIG. 6.
[76] The purpose of the ART protocol is to:
[77] -Specifying methods for multilateral transmission and reception of voice, image, message, etc.
[78] Persistent Connection and Spring GETting (waiting after connection, reconnect when disconnected)
[79] -Receive tunneled data by GET of HTTP
[80] -It supports to perform the function of transmitting tunneled data by HTTP's POST, which is one of the core technologies of the present invention.
[81] FIG. 6 is a flowchart illustrating a case in which Client A 70 requests Client B to make a call as a call is set up.
[82] ① As a server connection maintenance message of Client A and B, when the client transmits using HTTP GET 71, the doGET 75 routine of the session manager 74 of the server receives it and holds the connection state. (73).
[83] (2) Client A requests the server to send a session connection signal to Client B. When the client transmits the data using the HTTP POST 72, the doPost 76 routine of the server's session manager receives it.
[84] From the message in ③, the server generates a unique session ID and responds to the sender's GET socket 31.
[85] ④ The server informs Client B that Client A has a session connection request and delivers it with the session number. At this time, Client B is not unique, and is transmitted to all of the included receivers, such as Client C, D, and E (77).
[86] ⑤ Same as ①.
[87] ⑥ Same as ①.
[88] ⑦ Client B notifies the server of the result of allowing the session connection.
[89] ⑧ The server receives it and delivers the result of Client B's session connection permission to Client A.
[90] ⑨ Same as ①
[91] 7 shows a process of transmitting and receiving actual data after call setup is completed.
[92] ① and ② have the same function as ① of FIG. 6.
[93] ③ The client sends the desired data to the server, including its ID and session ID.
[94] ④ The server detects the session ID from the received data and delivers it to the HTTP GET socket of all clients with the corresponding session ID.
[95] ⑤ Same as ①.
[96] As described above, the present invention is an instant multimedia messenger for a general Internet user and a corporate environment, even if a firewall is installed between end-users or a user who uses a virtual IP, effective information sharing and cooperation through simple messaging to multimedia information transmission. Since there is an advantage to support work, it can be utilized in KMS, ERP, and distance education system to maximize user convenience and greatly reduce communication charges.

权利要求:
Claims (4)
[1" claim-type="Currently amended] In the multimedia electronic exchange system used by the multimedia messenger to support firewall and virtual IP,
-With all clients connected to the server by GET method through HTTP tunneling, the sending client sends data by POST method, and the reception is made by the server response of the connected GET client-> server-> client (PSP). Data transmission method using method of transmission flow of
[2" claim-type="Currently amended] For many-to-many communication, a many-to-many communication method using a method of generating a unique session ID when communicating with each client and distributing data to clients having the same session ID when joining the session with the generated session ID.
[3" claim-type="Currently amended] Switching server is divided into message part, live streaming part and file part to exchange each media independently
[4" claim-type="Currently amended] A system embodying a communication system in the manner of claims 1,2 and 3 based on an instant messenger having a function of status information

类似技术:

---

公开号 | 公开日 | 专利标题

---

US9537667B2|2017-01-03|Duplicating digital streams for digital conferencing using switching technologies

---

US9252963B2|2016-02-02|Performing multicast communication in computer networks by using overlay routing

---

JP6046009B2|2016-12-14|Method and apparatus for joining a group communication service in an existing communication system

---

US9185051B2|2015-11-10|Supporting enhanced media communications using a packet-based communication link

---

US9391786B1|2016-07-12|Systems and methods for setting up a session in a collaborative communication system

---

EP2599291B1|2019-09-04|Method for transferring a collaboration session

---

ES2469852T3|2014-06-20|Procedure and devices for registering client computing devices for online communication sessions

---

JP4944238B2|2012-05-30|System and method for providing group communication service

---

JP5318816B2|2013-10-16|Communication device for providing multimedia in a group communication network

---

JP4444518B2|2010-03-31|A distributed system that establishes intelligent sessions between anonymous users over various networks

---

US6138144A|2000-10-24|Method for managing multicast addresses for transmitting and receiving multimedia conferencing information on an internet protocol | network implemented over an ATM network

---

EP1389862B1|2004-11-03|Lawful interception for VoIP calls in IP based networks

---

US8994778B2|2015-03-31|Systems and methods for providing video conferencing services via an ethernet adapter

---

US6965614B1|2005-11-15|Method and system for communications between different types of devices

---

CA2470226C|2009-10-13|Voip system, voip server and client, and multicast packet communication method

---

Schulzrinne et al.2000|The session initiation protocol: Internet-centric signaling

---

US6857072B1|2005-02-15|System and method for enabling encryption/authentication of a telephony network

---

Wang et al.2000|ICEBERG: An Internet core network architecture for integrated communications

---

KR101033057B1|2011-05-06|Method and apparatus for establishing multicast groups

---

US8689313B2|2014-04-01|Real time streaming data communications through a security device

---

US7313593B1|2007-12-25|Method and apparatus for providing full duplex and multipoint IP audio streaming

---

JP3216992B2|2001-10-09|Connection method in network system and server machine

---

JP5519183B2|2014-06-11|Voice call realization method via CCN

---

US8565267B2|2013-10-22|Web based unified communication system and method, and web communication manager

---

EP2176987B1|2012-09-19|Multi-point to multi-point intercom system

同族专利:

---

公开号 | 公开日

---

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

法律状态:
2002-03-13|Application filed by 주식회사 알파인터넷

---

2002-03-13|Priority to KR1020020013677A

---

2003-09-19|Publication of KR20030073911A

优先权:

---

申请号 | 申请日 | 专利标题

---

KR1020020013677A|KR20030073911A|2002-03-13|2002-03-13|Multimedia Messenger and Multimedia PBX Server for Firewall and Virtual-IP Environment|